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ABSTRACT 

Introduction: Low vaccine coverage is a major public 
health concern, the consequences of which contribute 
to around 1.5 million child deaths from vaccine- 
preventable diseases. Thus, innovative strategies to 
rapidly increase coverage and recall rates for 
vaccinations are urgently required. Mobile text 
messaging (or short messaging service, SMS) has the 
potential to help increase vaccination coverage and 
therefore we propose to conduct a review of the 
current best evidence for the use of SMS as an 
intervention to promote vaccination coverage. 
Methods and analysis: This article describes the 
protocol for a systematic review of the effectiveness of 
SMS in improving the uptake of vaccination. Primary 
and secondary outcomes of interest are prespecified. 
We will preferably include randomised controlled trials 
(RCTs). However, non-randomised studies (NRS) will 
be considered if there is an inadequate number of 
RCTs. We will search several bibliographic databases 
(eg,PubMed, EMBASE, CINAHL, CENTRAL, Science 
Citation Index, Africa-Wide Information and WHOLIS 
electronic databases and search sources for grey 
literature. Following data extraction and assessment of 
risk of bias, we will meta-analyse studies and conduct 
subgroup analyses, according to intervention subtypes. 
We will assess clinical heterogeneity and statistical 
heterogeneity. For outcomes without quantitative data, 
a descriptive analysis will be used. This review protocol 
is registered in the PROSPERO International 
Prospective Register of systematic reviews, registration 
number 2014:CRD42014007531 
Ethics and dissemination: Ethics is not required for 
this study, given that this is a protocol for a systematic 
review, which uses published data. The findings of this 
study will be disseminated through peer-reviewed 
publications and conference presentations. We 
anticipate that the results could be used by researchers 
and policymakers to help inform them of the efficacy of 
mobile phone text messaging interventions to promote 
increased vaccination coverage. 
Trial registration number: PROSPERO registration 
number 2014:CRD42014007531. 



Strengths and limitations of this study 
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INTRODUCTION 

Vaccinations, when given at the most sensi- 
tive developmental years of childhood, help 



To our knowledge, this is the first systematic 
review protocol that will attempt to assess the 
impact of mobile text messaging on promoting 
the uptake of vaccination among adults, adoles- 
cents and parents or caregivers of children. 
This study will help inform clinical practice and 
future studies on the effectiveness of media 
platforms. 

Non-randomised studies of low-quality evidence 
may be this study's limitation. We will, however, 
conduct appropriate analyses to assess the 
overall robustness of the results, 



to promote comprehensive and capable 
immunity, enabling children to fight off 
certain diseases/ ^ In addition, vaccinations 
are widely regarded as one of the most cost- 
effective public health interventions that 
help to reduce global child morbidity and 
mortality.^ ^ Low coverage of vaccinations is a 
major public health concern. In Africa 
alone, more than seven million children did 
not receive the full spectrum of vaccinations 
recommended before reaching 1 year of age 
in 2009.^ It is also estimated that 1.5 million 
children died globally from vaccine- 
preventable diseases where WHO pre- 
qualified vaccines were available.^ 

The Global Vaccine Action plan (GWP) is 
the most recently launched global effort by 
the WHO to help increase vaccination cover- 
age. The GVAP has set a target that by 2020 
vaccination coverage for populations should 
reach 90% national vaccination coverage and 
at least 80% at district levels utilising national 
vaccination programmes.^ It is guided by six 
principles: country ownership, shared 
responsibility and partnership, equity, inte- 
gration, sustainability and innovation.^ 

A variety of factors impact achieving low 
coverage rates; challenges such as immunisa- 
tion awareness, demand for immunisation, 
level of trust in the health system, adequate 
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human resources, access, timeliness of vaccinations, 
service delivery, poor infrastructure and vaccination 
monitoring."^ Vaccination coverage seems to be lower in 
low-income households, where limited access to health 
education, contributes to poor health-seeking behaviour 
along with an inability to improve general well-being/ ^ ^ 
Uneducated parents therefore are less likely to 
understand the importance of vaccinating to prevent 
potentially harmful diseases. In light of these obstacles 
to vaccination coverage, the strategy to improve 
vaccination coverage needs to be innovative as alluded 
to in the GWP, well thought out and able to penetrate 
low-income households effectively. 

Globally, mobile phone use is rapidly increasing, with 
an estimated six billion mobile phone users worldwide 
at the end of 2011.^^ In particular, mobile phone text 
messaging has gained popularity among people living in 
low-income and middle-income countries and may be 
the key to penetrating hard to reach areas in the devel- 
oping world. Text messaging has proven to be a cost- 
effective method of relaying health information and 
reminders than the more traditional methods such as 
face-to-face, phone calls, pamphlets, mail and email.^ As 
immunisation usually requires multiple consecutive 
monthly visits after the first vaccine dose in order to 
complete the schedule, short messaging service (SMS) 
can be used as reminder for an upcoming visit and 
recall when a visit has been missed.^ In addition, an 
SMS intervention, also known as mobile phone text mes- 
saging, can be delivered alone or bundled with other 
interventions.^^ Diseases that have used mobile technol- 
ogy successfully include HIV where a 90% adherence 
was observed among text message recipients compared 
with a 40% adherence in the control group. We there- 
fore propose to conduct a systematic review of the 
current best evidence for the use of mobile phone text 
messaging to improve vaccination coverage. 



METHODS 

This review protocol has been published in the 
PROSPERO International Prospective Register of system- 
atic reviews (http://www.crd.york.ac.uk/PROSPERO), 
registration number 2014:CRD42014007531. The 
methods for this review will follow those published 
previously. 

Criteria for considering studies for this review 

Type of studies 

We will include randomised controlled trials (RCTs), 
interrupted time series and controlled before and after 
studies. 

Types of participants 

Participants will be caregivers of infants or children, ado- 
lescents and adults including pregnant women drawn 
from any setting, community-based or otherwise. 



Types of interventions 

We will include interventions in which mobile phone 
text messages serve as a reminder to be vaccinated, as 
educational information or, as information regarding 
vaccine availability at the clinic in an attempt to 
promote uptake of vaccinations. Vaccinations could 
include routine infant immunisations, those against 
human papilloma virus, influenza, meningococcal or 
tetanus/diptheria/accellular pertussis. Eligible studies 
will be those that compared SMS to no intervention, or 
to other interventions for increasing vaccination cover- 
age. If we find less than 10 studies that include only SMS 
as the intervention, we will include studies in which 
mobile phone voice speaking or voice messaging are 
interventions; studies in which the use of a beeper or 
pager is the intervention; studies in which the use of 
multimedia messaging service is the intervention; and 
studies in which text messages are bundled with other 
interventions. In such circumstances, we will stratify the 
analysis by type of intervention. 

Types of outconne nneasures 

Results must include quantitative data for outcomes 
measured. 

Primary outcomes 

The primary outcome is vaccination coverage, irrespect- 
ive of disease. We will use the definition of vaccine cover- 
age as stipulated by the respective authors. 

Secondary outcomes 

Secondary outcomes are the recall rate in persons who 
had previously missed their vaccinations, scheduled 
appointments for vaccination or completeness of vaccin- 
ation records. 

Searcli methods for identification of studies 

A comprehensive and exhaustive search of databases 
and conference proceedings will be performed by RK 
with the help of the University of Cape Town librarian, 
to identify all relevant studies available by 30 June 2014, 
regardless of language or publication status. We will 
search both peer-reviewed journal articles and grey lit- 
erature (unpublished, internal or non-reviewed papers 
and reports). 

Database 

We will search the following electronic databases: PubMed; 
EMBASE; Cochrane Central Register of Controlled Trials 
(CENTRAL); ISI Web of Science (Science Citation Index); 
Africa-Wide Information, Cumulative Index of Nursing 
and Allied Health (CINAHL) and WHO library databases 
(WHOLIS). We will use both text words and medical 
subject heading (MeSH) terms; for example vaccination*, 
immunization*, immunisation*, "Immunization" (MeSH), 
"Vaccination" (MeSH) , "Immunization, Secondary" (MeSH) 
OR "Immunization Programs" (MeSH), "Immunization 
Schedule" (MeSH), "Mass Vaccination" (MeSH) , mobile 
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phone, text messaging, text*, SMS, reminder*, recall, tele- 
medicine, mHealth and eHealth. These terms will be used 
in varying combinations. The literature search strategy will 
be adapted to suit each database. Table 1 shows the main 
search strategy we will use. 

Conference proceedings 

We will search the following conference proceedings for 
relevant abstracts: Vaccine and International Society for 
Vaccines Congress, International African Vaccinology 
Conference, Annual Vaccines Congress, Annual Con- 
ference on Vaccine Research, World Congress on 
Pediatric Infectious Diseases, International Pediatric 
Association Conference, National Immunization 
Conference and the Annual Infectious Diseases in 
Children Symposium. 

Searching other sources 

For ongoing studies, we will search the WHO 
International Clinical trials Registry Platform, 
Clinicaltrials.gov, Pan African Clinical Trials Registry 
(PACTR), and contact individual researchers working in 
the field as well as the following organisations: WHO, 
Global Alliance for Vaccines and Immunisation, Center 
for Disease Control and Prevention and mHealth 
Alliance. We will also search the website of mHealth 
Alliance and mHealth in the Low Resource Settings 
resources database for eligible studies. 

Reference lists 

We will obtain reference lists of relevant studies identi- 
fied and the full-text articles reviewed for inclusion in 
the review will be checked for additional information. 

Data collection and analysis 

The methods for data collection and analysis will be 
based on the Cochrane Handbook of Systematic Reviews 
for Interventions.^^ 

Selection of studies for inclusion 

We will construct a screening guide to ensure that the 
inclusion criteria are adhered to and consistently 
applied by all review authors. Two review authors (RK 



Table 1 


PubMed search strategy, modified as needed for 


use in other databases 


Search 


PubMed 


#1 


(immunization[Mesh]) OR ((immunis* OR 




immuniz* OR vaccin*) 


#2 


(adolescents OR children OR teenagers) 


#3 


'SMS' OR cellphone OR 'mobile phone' OR 'text 


i 


messaging' OR 'short message service' OR 'text 




reminder' 


#4 


#1 AND #2 


#5 


#3 AND #4 


Mpf^H mpHinfll .qiihippt hppHinn 



and MEE), working independently, will screen the titles 
and abstracts of all studies identified through the litera- 
ture searches for eligibility. RK will obtain the full text of 
studies deemed potentially eligible. The two authors 
(RK and MEE) will independently assess the full text of 
each article for eligibility, and compare their results and 
resolve discrepancies by discussion and consensus, con- 
sulting a third author (CSW) to resolve any persistent 
disagreements. For all studies excluded by the assessors 
we will describe the reasons for exclusion. 

Assessment of risk of bias in included studies 

Two authors will independently assess the risk of bias in 
the included studies. Separate criteria will be used to 
assess RCTs and non-randomised studies. The criteria 
used to assess the risk of bias of in RCTs will be random 
sequence generation; allocation concealment; blinding 
of participants, study personnel; blinding of outcome 
assessors; incomplete outcome data; selective outcome 
reporting; other sources of bias and overall risk of bias, 
in accordance with the methods used by the Cochrane 
Collaboration^"^ as well as the Cochrane Consumers and 
Communication Review Group. The criteria used for 
risk of bias assessment for non-randomised studies will 
include selection bias (with regard to comparability of 
groups, confounding and adjustment); performance 
bias (in terms of the fidelity of the interventions and 
quality of the information regarding who received which 
interventions, including blinding of study participants 
and healthcare providers); detection bias (regarding 
unbiased and correct assessment of outcomes, including 
blinding of assessors); attrition bias (with regard to com- 
pleteness of sample, follow-up and data); and reporting 
bias (with regard to publication biases and selective 
reporting of results). Studies will be scored as having 
low, high or unclear risk of bias. The two authors will 
resolve disagreements in the assessment of risk of bias by 
discussion and consensus, consulting a third author to 
resolve any persistent disagreements. 

Data extraction and management 

References will be managed using Thomson ISI 
Research-Soft Endnote V9.0.^^ Two authors will inde- 
pendently extract descriptive and outcome data for each 
included article using a standardised data collection 
form, resolving any discrepancies by discussion and con- 
sensus; failing which, a third author (CSW) will arbitrate. 
RK will enter the final data into the Cochrane 
Collaboration Review Manager V.5.1 statistical software 
(http://ims.cochrane.org/RevMan). CW will crosscheck 
the data entered to ensure that there are no data entry 
errors. 

Data synthesis including assessment of heterogeneity 

Data analysis will be conducted using the Cochrane 
Collaboration Review Manager V.5.1 statistical software 
(http://ims.cochrane.org/RevMan). The outcomes of 
interest will be either dichotomous or continuous. We 
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will calculate risk ratios and their corresponding 95% 
CIs and p values for dichotomous outcomes, and mean 
differences and SDs for continuous outcomes. Where 
outcomes are measured using different scales, we will 
report standardised mean differences (SMD)/'^ In cases 
of missing or incomplete information presented in the 
included studies, we shall contact authors for further 
information. 

We will assess clinical heterogeneity by examining 
types of participants, interventions and outcomes in 
each study. We will pool data only from studies judged to 
be clinically homogenous. Statistical heterogeneity in 
each meta-analysis will be assessed using the ^ test and 
quantified using the statistic. If studies are suffi- 
ciently homogenous (in terms of study populations, 
interventions and outcomes), then we will pool the data 
across studies and estimate summary effect sizes using a 
fixed-effects model. Otherwise, we will use the 
random-effects model. Should heterogeneity remain sig- 
nificant, we will discuss the findings as a narrative 
summary. 

We will perform subgroup analyses by intervention 
subtypes: long versus short messages; daily versus weekly 
messages; short weekly messages versus long weekly mes- 
sages; short daily messages versus long daily messages; 
and two-way interactive communication versus one-way 
communication.^^ We will also stratify analysis by 

study design (randomised controlled separate from non- 
randomised studies) and intervention type (multiple 
interventions involving text messaging separate from 
text messaging alone). We will also conduct a subgroup 
comparison of self-reported vaccination completion 
versus verified clinic records as well as according to age 
categories and country setting. 

Finally, we will use the grading of recommendations 
assessment, development and evaluation (GRADE) 
approach^ ^ to assess the quality of evidence for the 
effectiveness of the SMS intervention. This method 
results in an assessment of the quality of the body of evi- 
dence as high, moderate, low or very low. Evidence is 
considered of high quality if 'further research is very 
unlikely to change our confidence in the estimate of 
effect'; and moderate quality if 'further research is likely 
to have an important impact on our confidence in the 
estimate of effect and may change the estimate'. Low 
quality evidence implies that 'further research is very 
likely to have an important impact on our confidence in 
the estimate of effect and is likely to change the esti- 
mate', and very low quality that 'we have very little confi- 
dence in the effect estimate'. 

Sensitivity analyses 

Several sensitivity analyses will be performed: first to 
determine whether the study design (RCT vs non- 
randomised study) could influence the results of the 
meta-analysis; second, to evaluate whether the model of 
the statistical method (random-effects vs fixed-effects 
model) could change the results and third, to 



determine the impact of excluding studies with a high- 
risk bias on the results, with emphasis on allocation con- 
cealment, blinded outcome assessment and losses to 
follow-up (with a cut-off of 25% loss to follow-up). 



Reporting of this review 

Findings in our systematic review will be presented in 
several ways. Flow diagrams will be used to summarise 
the study selection process. Funnel plots will be used to 
assess publication bias if we identify 10 or more eligible 
studies. The k statistic^^ will be used to assess agreements 
between the full-text screening, data extraction and risk 
of bias assessment by the two authors (RK and MEE). 
GRADE summary of tables of findings, risk of bias tables 
or graphs and forest plots will also be used where appro- 
priate. The reporting of outcomes without quantitative 
data will be descriptive. Lastly, we will provide a list of 
excluded studies with reasons for exclusion. 



Etiiics and dissemination 

Systematic reviews draw on publicly available data and 
do not directly involve human participants, and there- 
fore do not require formal ethical review.^^ The study 
protocol will be reviewed by supervisors with expertise in 
methodology (systematic review) and submitted to the 
University of Cape Town Departmental Research 
Committee for approval. 

The findings of this systematic review will have implica- 
tions for policy, practice and research. We will discuss 
the relevance of our findings to childhood immunisa- 
tion programmes in Africa in the decade of vaccines 
with emphasis on applicability, effects on equity, cost 
implications and monitoring and evaluation. Our system- 
atic review will provide evidence of whether policy- 
makers can adopt mobile phone text messaging alone 
or in combination with other interventions in efforts to 
improve uptake of vaccines in national immunisation 
programmes. It will also inform clinic or hospital man- 
agers of how best to use the intervention to improve vac- 
cination coverage. The systematic review may also 
identify specific considerations that would need to be 
taken into account for future studies, such as study loca- 
tion, content and timing of messages, whether or not 
parents or caregivers replied to text messages, how text 
messages were sent (automated vs manual), indicators 
for immunisation programmes, variety of text messages 
sent (inclusion of jokes or lifestyle tips), duration of the 
study, whether or not participants were provided with 
the mobile handsets and sample size.^^ 
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